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1 Introduction 



In this note we consider the f^-form of a family of Dirac operators T>(b), b G B, on the 
interval [0, 1] over a base space B. The 77-form was introduced by Bismut-Cheeger [[| as 
the boundary contribution to the local index theorem for families of Dirac operators. In 
our case the operator T>(b) depends on b G B only through the boundary conditions. If 
B is a point, then the 77-form reduces to the usual 77-invariant of T> which was explicitly 
calculated by Lesch-Wojciechowski J7|. In Q we found a relation between the ^-invariant 
and the Maslov index. The Maslov index was first introduced in Wall [|l(] 



as a measure 



of the non-additivity under gluing of the signature of manifolds with boundary. This 
non-additivity was generalized to arbitrary Dirac operators in M. 



In the present note we relate the ?7-form with a family version of the Maslov index. The 
family version of the Maslov index conjecturally plays the same role in the non-additivity 
of the family index of families of Dirac operators on manifolds with cylindrical ends (or 
APS-boundary conditions) as the usual Maslov index does for the usual index. 



Let V be a finite-dimensional Hilbert space equipped with a hermitean symplectic 
structure Q (this just means that iQ is a non-degenerate hermitean form of index (1,1), 
dim c (V) = 21). If {L (b), Li(b)}b£B is a smooth family of pairs of transverse Lagrangian 
subspaces of V, then we define the ry-form rj(L ,Li) G C°°(B,A ev T*B). Our main result 
is 



Theorem 1.1 If {L (b), L\(b), L 2 (&)}f, 6 £ is a smooth family of triples of pairwise trans- 
verse Lagrangian subspaces of V, then 

(1) d( v (L , L t ) + r)(Lx, L 2 ) + r)(L 2 , L )) = 0, 

(2) and if we define the cohomology class t(L , Li, L 2 ) by 

t(L , L x , La) := [ V (L , L x ) + T](Li, L 2 ) + V (L 2 , L )] G H even (B, R) , 

then t(Lq, L±, L 2 ) = ch(Lg ) — ch(Lp ), where Lq = Lq © Lq is the splitting of the bundle 
of Lagrangian subspaces Lq C B x V into the positive and negative eigenspaces of the 
quadratic form Q(x ) := Vl(x\,x 2 ), where Xi G L i} x = X\ + x 2 . 
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The proof of the theorem is based on a local index theorem for families of Dirac oper- 
ators on manifolds with cylindrical ends and boundaries with local boundary condition. 
Instead of saying how the existing proofs Bismut-Cheeger 0, Melrose-Piazza || should 
be modified in order to include the additional boundaries we prefer to work out again the 
essential arguments. Our approach is modelled on the 6-calculus proof of ||, but is more 
direct and might be of independent interest. 



2 Definition of ?7(Lo, Li) 



Let V be a finite-dimensional complex Hilbert space with scalar product (., .). Let I G 
End(V) be a complex structure, i.e. I 2 = — 1, I* = —I. We assume that tr / = 0. Then 
Q(x, y) := (Ix,y) is a hermitean symplectic structure on V. We consider the formally 
selfadjoint differential operator D := 1-^ acting on C°°([0, 1], V). 

A complex subspace L C Vis called Lagrangian, if L _L IL and L®IL = V. We want 
to consider D as an unbounded operator on the Hilbert space L 2 ([0, 1], V). In order to 
define selfadjoint extensions T> of D we choose two Lagrangian subspaces Lj C V, i = 0, 1. 
Then we define the domain dom(T>) of T> by 

dom(D) := {/ G C°°([0, 1], V) \ f(i) G L u i = 0, 1} . 

It can be shown that T> is essentially selfadjoint and we denote its unique selfadjoint 
extension by V, too. It is easy to see that V is invertible iff L fl L\ = 0. 

We now turn to families. Let B be some manifold. We consider a pair of smooth 
families of Lagrangian subspaces B 3 b i— > Li(b), i = 0, 1, and we assume that Lo(b) fl 
Liip) = 0, Wb G B. We obtain a corresponding family {T>(b)}b<=B of invertible operators. 
We want to apply the superconnection formalism in order to define the ?7-form of that 
family. Since this formalism involves derivatives of the family with respect to b we prefer 
to work with an unitarily equivalent family {T>(b)}teB which has the advantage that its 
domain is independent of b G B. 
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The ?7-form is a local object with respect to the base space. In order to define it we 
only consider a germ of the family near a point 60 £ B. Let Ui(V) denote the group of 
unitary operators on V which commute with I. The group Uj(V) acts transitively on the 
space A of all Lagrangian subspaces of V. Thus we can find germs of smooth families of 
unitaries b 1— > Ui(b) G Ui(V), i — 0, 1, with Ui(b ) = 1 and Ui(b)Li(b) = Li(b ). We can 
define germs of smooth families Ai(b) := log(Ui(b)) of anti-hermitean matrices using the 
standard branch of the logarithm. Let Xt £ C°°([0, 1]) be cut-off functions with Xo(t) — 1 
for t < 1/5, Xo{t) = for t > 2/5, xi(t) = 1 for t > 4/5, and = for t < 3/5. Then 
we set W(t, b) := exp(xo(t)Ao(b) + Then 6 1— > 6) can be considered as a 

germ of a family of unitary multiplication operators on L 2 ([0, 1], V). We set 



where '"" denotes the derivative with respect to t. We define the selfadjoint extension of 
T>(b) using the Lagrangian subspaces Lo(6q), Li(b ). Then V{b) is unitarily equivalent to 
T>(b) and its domain is independent of b. 

We now turn to the definition of the 77-form of the family {V(b)}beB- Let C\ denote 
the graded algebra over C generated by a satisfying a 2 = 1, a* = a, and deg(a) = 1. Let 
TC denote the germ at bo of the trivial Hilbert space bundle with fibre L 2 ([0, 1], V) ® Ci 
over 5. We define the superconnection A s , s > 0, on Ti associated to D by 



where d differentiates along B. Here V is the canonical connection of 7i and V — d(xoAo + 
X1A-1) = WVW*. For Re(it) > 1 we can define the holomorphic family of germs of smooth, 
even differential forms 



Here tr^ en (. . .) stands for the even form part of tr(er . . .). As usual the asymptotic expan- 
sion of the heat kernels for small times implies that rj (u) has a meromorphic continuation 



D(b) 



W(.,b)DW*(.,b) 

D - x' lMb) ~ x[lMb) , 



As = V - d( Xo A + xxAx) + V^aV 




(1) 



with respect to u to all of C having at most first order poles. Following |5j we define 



Definition 2.1 



7]{V) := P.F. 77(0) , 



3 THE MASLOV COCYCLE 



4 



where " P.F." stands for the finite part of the Laurent expansion of i](u) at u = 0. As 
defined above the form rj(T>) may depend on the choices made for the definition of T>. 
But the following lemma justifies the notation i](L , L{) := f]{T>). 

Lemma 2.2 r)(V) does not depend on the choices of the families Ut and the cut-off func- 
tions Xi- 

Proof. Let Ui, \% De another choice and define W as above. Let T> denote the corresponding 
family of operators. We set V = WW*. Then T> = V*T>V. If A s is the superconnection 
associated to V, then A s = V*A S V. It is now easy to check that i)(u) = n(u) if t)(u) 
corresponds to A s . □ 



3 The Maslov cocycle 

Now we turn to the generalized Maslov index. Let {L.j(6)}& e s, i = 0,1,2, be smooth 
families of Lagrangian subspaces of V such that Li(b) D Lj(b) = {0}, Wb G B, i ^ j. Let 
ch : K°(B) — > H ev (B, R) be the Chern character. In the present section we prove 

Proposition 3.1 The form rj(L , Li) + 77(^1, L 2 ) + t](L2, L ) is closed. Moreover 
t(L , L u L 2 ) := [ V (L Q , L,) + V (L U L 2 ) + V (L 2 , L )} e ch(K°(B)) C H even (B, R) . 

Remark: The zero component t(L , Li, L 2 )° G Z is the Maslov index (in its hermitean 
symplectic generalization) of the triple (L ,Li,L 2 ) (see 0). For an exposition of the 
usual Maslov index we refer to M). In Proposition [O] below we explicitly compute the 
class t(Lq, Li, L 2 ) G H even (B,H) in terms of the hermitean symplectic geometry of the 
family {L (b), L^b), L 2 (b)} beB . 
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Proof. The idea of the proof is to formulate an index problem for a family of Dirac 
operators jd + such that the form rj(Lo,Li) + r)(Li,L,2) + 77(^2, -^o) represents the Chern 
character of the index bundle of /9 + . 

We consider a compact oriented Riemann surface M c which is homeomorphic to a disc, 
and the boundary of which is the union of twelve pieces d{M c , % — 0, . . . , 11. The boundary 
pieces are labelled in their cyclic order. We assume that <9jM c are isometric to the interval 
[0, 1], and that the boundary pieces intersect in twelve corners. We assume that the metric 
is product in a neighbourhood of the interior of the pieces and that neighbourhoods of the 
corners are isometric to a neighbourhood of the vertex of the euclidean quadrant R + x R + . 

Let M be the oriented, non-compact Riemann surface with six boundary components 
<9jM, i — 0, ... ,5, isomorphic to R which is obtained by gluing infinite cylinders [0, oo) x 
[0, 1] along the boundary pieces of M c with odd label. The boundary components of M 
are again labelled according to their cyclic order. 

We consider the spinor bundle S = S + © S~ of M and fix a finite-dimensional Hilbert 
space W of dimension dim(V)/2. We consider the graded vector bundle E = S <8> (W © 
W op ). By jd we denote the corresponding twisted Dirac operator. Let /9 ± be the parts 
mapping sections of E ± to those of E T . We formulate an index problem for /) + by putting 
boundary conditions at djM depending on Lj(fe), i = 0,1, 2. 

The metric of M is flat near infinity and the boundaries (the flat region). We claim 
that the holonomy of the parallel transport in S along dM c is trivial, where we consider 
M c as a submanifold of M. Note that M is topologically a disc. Thus we can choose a 
trivialization of the tangent bundle TM. Measured with respect to the trivialization the 
parallel transport in TM along dM c gives a rotation of — 4ir. The trivialization of TM 
induces one of the Spin (2)-principal bundle of M. The parallel transport along dM c in 
this bundle corresponds to a rotation of — 2n in the structure group. This implies the 
claim. We fix some point in dM c and identify the fibres of the bundle S near infinity and 
dM with the fibre over this point using the parallel transport. We denote this fibre by S, 
too. Analogously we also denote the fibre of E over this point by E. 



3 THE MASLOV COCYCLE 



6 



Let (s, t) be oriented euclidean orthonormal coordinates near a point in the flat region. 
Then we have jd = a s d s + <y t d t , where a s ,a t G Hom° dd (E, E) depend on the choice of 
coordinates. Again we consider the components erf, erf G YioTa odd (E ± , E T ). The operator 
/ := <J~crf G Aut(£' + ) is invariantly defined. It satisfies I* = — 1, I 2 = — 1, tr/ = 0, and 
it defines a hermitean symplectic structure on E + . We fix an isometry V = E + which is 
compatible with the complex structures I on V and E + . 

Now we introduce the family of boundary conditions defining the family {/9 + (&)} bgB . 
Let C%(M, E±) denote the space of all sections of E ± which are square integrable together 
with all their derivatives. We let jd + (b) be the differential operator /9 + mapping 

{(f) G C%(M, E + ) | <j>{x) G Li(b)\/x G diM or x G d i+3 M} 

to C${M,E-). 

First we show that jd + (b) gives rise to a smooth family of Fredholm operators such 
that the index bundle is well-defined. Then we apply the superconnection formalism in 
order to compute the Chern character of the index bundle. 

First we conjugate the family {ft + (b)}beB to a family {/) + (6)} 66B with constant do- 
main. This will be done again on the level of germs at a point b G B. In the remainder 
of the present section we replace B by a sufficiently small neighbourhood of bo. We define 
a germ of a family of smooth [/(V)-vahied functions W + (b, m), m G M, such that near 

d t M, d i+3 M, 

W + (b,(s,t))=ex V (xo(s)A(b)) , (2) 

where A iy xo were defined above. Here (s,t) are orthonormal euclidean coordinates, s 
being normal to the boundary given by s = 0. W + is determined by (0) near dM 
and we continue W + to the interior of M by the constant 1 G U(V). Similarly we set 
W~ = — afW + a~ near dM and continue W~ to the interior of M by 1 G E~ . 

Let f) + := W~ f)(W + )* . Then /) + (b) is a germ of a family of (now 6-dependent) 
Dirac operators with domain (now independent of b) given as above by the Lagrangian 
subspaces Li (bo) at diM, di +3 M. 



3 THE MASLOV COCYCLE 



7 



,+ 



For i = 0, . . . , 5 the family /) (b) induces families of translation invariant operators 
(b) on the infinite cylinder Rx [0, 1]. Let (b) be the formal adjoint (with the adjoint 
boundary condition) of (b) and let 



It is easy to check that the boundary condition satisfies the condition of Lopatinski- 
Shapiro. Hence /^(ft) has a parametrix of bounded propagation. It follows that fl^b) is 
essentially selfadjoint on the space of smooth sections with compact support satisfying the 
boundary condition. Using separation of variables and the transversality of the Lagrangian 
subspaces one can then check that jd^b) is invertible. 

Gluing the distributional kernels of the (/9j(5)) _1 , % = 0, . . . , 5, at infinity with a local 
parametrix of jd(b) we obtain a parametrix Q(b) of jd(b) depending smoothly on b. In 
particular, the smoothing remainders jd(b)Q(b) — 1, Q(b) jd(b) — 1 have compact support. 
{jd(b)} is a family of essentially selfadjoint operators. The domain of definition H. of 
the unique selfadjoint extension of f)(b) is independent of b. When viewed as a family 
of bounded operators from 7i + to L 2 (M, E~) the family {/9 + (6)} is a smooth family of 
Fredholm operators and the index bundle of /) + (b) is well defined. 

We now apply the superconnection formalism in order to obtain a formula for the 
Chern character ch ( index (/9 + )) of the index bundle of {f) + \b)}b&B- Our main goal is to 
work out the computation which gives the 77-form as the boundary contribution to Chern 
character of the index bundle. We supress the standard arguments (see Ch.9.5, [|]) 
which show that the small time analysis of the heat trace indeed gives a representative 
of the Chern form of the index bundle. In particular, we assume for simplicity that 
dimker /) + (b) is constant. 

Let V denote the trivial connection on the bundle B x 7i. We set W := W + © W~ . 
Let V = PFViy*. Then we define the superconnection 




B t = V + 
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The curvature B\ has the form 

B\ = tft 2 + VtR , 

where R is a one-form with values in the odd endomorphisms of E. The heat operator 
e~ B t can be constructed using the Volterra series []J, Prop. 9. 46. Let P t (x,y) denote the 
smooth integral kernel of e _B *. In order to simplify the notation we omit the smooth 
dependence on b G B. 

Note that M is a manifold with a cylindrical end N x [0, oo), where N is isometric 
to the disjoint union of six copies of the unit interval. Let (n, r) denote corresponding 
coordinates. Though e~ B t is not of trace class we define 

Tr'e~ B * := / tr s P t (x, x)dx + lim / / tr s P t ( ( n, r), (n,r))dndr . 

JM C u-kjoJo J N 

We first argue that this limit exists. We claim that for some C < oo, c > 0, 

\tr s P t ((n,r),(n,r))\<Ce- cr2 . 

The constants C, c can be choosen uniformly for t varying in compact subsets of (0, oo). 
Consider the infinite cylinder Z := N x R. Let E z be the bundle on Z induced by 
E. Let {p (b)}b e B denote the family of translation invariant operators on E z induced 
by {jd(b)}beB- Let TC Z the domain of f)(b) z which is again independent of b G B. We 
then obtain a translation invariant superconnection B z on the bundle B x 7i z . Let 
P z ((n,r), (m, s)) denote the corresponding heat kernel. The Clifford multiplication by 
ia T is unitary, odd, and commutes with (B z ) 2 . Thus 

tT s P t z ((n,r),(n,r)) = . 

Using standard finite-propagation speed estimates one can show that for r > 

\Pf((n, r), (n, r)) - P t ((n, r), (n, r))| < Ce~ cr2 , 

and this proves the claim. 

Let T> z be the family of operators on N x V induced by jd . Then D z can be identified 
with the dirct sum of two copies of the direct sum of three copies of T> with boundary 
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conditions given by the families of pairs (Lq, Li), (Li, L2), (L2, Lo). By we denote the 
superconnection corresponding to V z . 

Set 7 := ay G End(L'). The comparison with the cylinder Z shows that Tr' s e~ B * can 
be differentiated with respect to t. Using Duhamel's formula one can check that one can 
commute Tr' s and d/dt. 



Lemma 3.2 



d 



^Tr' s e" B ? = 
dt 3 



2y/t 



dTr' s ~fie 



-B? 



Proof. First we claim that 



d __ , r2 _ . r dBf r>2, 

Tr' s e- B * = —Tr s [B t , 



dt s SL ' dt 

Let p u denote the characteristic function of M c UN x [0, u\. Using Duhamel's formula we 
get 

^Tr' s e- B ? = -Tr' s f'e-^^le-^^ds 
dt s s Jo dt 

= -lim f 1 T IsPu e-^ ^le-^- s ^ds 
Jo dt 

= - lim /' 1 Tr s [^, J B t ]e-^ 2 p u e-( 1 - s ) B ^ S 

= - lim lim f 1 Tr aPv [^ B^e-'^^-'^ds 

= -lim lim / TT s p v [^,B t ]e~ sB 'p u e-^ s ^ds 

= - lim f 1 Tr s p v [^ : B t ]e- B *ds 
v-*°°Jo dt 



-tf.[ft,fe-« 



In order to justify that lim^oo and lim^oo can be interchanged one can again use the 
comparison with the infinite cylinder Z. We use 

dB t _ 1 ~ 
dt 2y/i 
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in order to write 



Tr^ t) ^ 2 ] = -^[Vje^l-^IA^ 2 ] (3) 



1 .„ , ~k d2 1 



oy _dIV^e- B ?--^[A^e-^]. (4) 

Before justifying the transition from ([3D to (P we consider the second term of (J|). Let z 
denote the Z2 grading operator. By integration by parts we obtain 

= _ Ilr'z tfV 5 ' 2 - -Tr'z Be~ B ? ~B 
2 H 2 M H 

= — lim / / Xxz( jb e~ Bt )((n,u), (n,u))dndu / trz( /d e~ Bt )(m, m)dm 

2 u^oo J J N 2 Jm c 

— lim / f trz(/)e~ Bt f))((n, u), (n, u))dndu [ trz( ~jdeT B ^ /9)(m, m)dm 

2 Jo jn 2 JMc 

= — lim / tiHz/)e~ Bt )((n, u), (n, u)) 

2 u^oo j N 

= 2 Jl™ J N tT s(l^ e ~ Bt ){( n ,u), (n,u)) . 

In order to evaluate this limit we can replace the kernel P t by P t z . We use the Volterra 
series I], Prop. 9. 46, in order to compute Pf. Note that on Z 

z — (r— s) 2 /4t 

e-*0 )2 ((n,r),(m,g)) = e- f( ^ Z)2 (n,m) e - , (5) 

V47rt 

and its follows 

P f = e -^ Z ) 2 + f)(_i) H k ' 2 f e-^fRZ . . . R\-^ z ? do f 

where denotes the standard fc-simplex. Inserting (|]) we obtain 

P t z ((n,r),(m, 8 )) 



-{r-sf/M / 
-*(^ Z ) 2 



We now apply 

i~p z = ~ + iv z 

or 

and evaluate the result at r = s. We then obtain 

-lim f ti s -?( ~de- B t)(n,u)dn = - lim / tr s 7(^e~ (B ' Z)2 )(n, w)dn = -^=Ti s jV z e~ iA ' )2 . 
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Now we consider the first term of (^). By a similar computation as above one can show 
that on the cylinder Z 

ti s [V z ,^ Z e' {B ' )2 }((n,r),(n,r)) = . 

Thus on M this quantity vanishes rapidly as r — > oo. We can take Tr' s and 

^Tr'jV, fte~ B t] = ^dTi'Je-^ 

2y/t SL J 2y/t 

is an exact form. This finishes the proof of the lemma. □ 



Let V° denote the induced connection on the index bundle of f) + and let ch(V°) = 
tr s e - ( v °) 2 be the corresponding Chern form. As in M, Ch. 9 or one can show the 
following estimates. 



Lemma 3.3 Let |.| be any continuous seminorm on the space of smooth forms on B. For 
t — > oo we have 



We conclude that 



exists and that 



where 



Tr' s e-^ -ch(V°)| = 0(t 

1 Tr'Je- B ?\ = 0(r 3 / 2 ) 



2y/i 



J™ -L=T Tsl VZ e ~ {A ? )2 dt =: fj(s) 



ch(V°) = Tr; e ~ B " + r)(s) + da(s) , (6) 



coo 1 „ 

n(s):=-l ^Tr' sJ de-^dt. (7) 



We now want to take the limit s — > 0. 
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Lemma 3.4 Let |.| be any continuous seminorm on the space of smooth forms on B. For 
t — > we have 

|Trle- B2 | = o(l) (8) 
1 Tr^e- B ?| = 0{r 1 ' 2 ) . (9) 



Proof. We first show (||). We employ finite propagation speed estimates and the comparison 
with the cylinder in order to show that on the end of M 

\tr s P t (n,r)\ < Ce"^* . 

The local index theorem Ch.10, gives |tr s P t (s)| = o(l) for x G M since S is twisted 
with a bundle of the form W © W op . Both estimates together give (f|). 

Now we consider (^). On the cylinder Z we have tr s f) e~( B ^ 2 (n,r) = 0. We conclude 
that on iV x [0, oo) c M \tr s jde~ B t (n, r)\ < Ce _r2// *. Moreover, for x in a small neigh- 
bourhood of the boundary of M c we have |tr s f)e~ Bt (x) \ < Ce~ c ^. If x is in the interior 
of M c we can employ the method of [|TJ, Ch. 10.5, in order to show that 

1 --tr s fie~ B t(x)\ =0(r 1/2 ) . 



l 2Vi 

The estimate (|9|) follows. □ 

Now we can take the limit s — > in (^). We obtain 

ch(V°) = 77(0) + da(0) . 

If rj(u, Li, Lj) denotes the form (|1|) which is defined using the boundary condition given 
by family of pairs (Lj, Lj), then 17(0) = lim u ^ (n(u, L , Li) + n(u, L 1 , L 2 ) + n(u, L 2 , L )). 
We conclude that 

res u=0 (77(M, L , L x ) + n(u, L h L 2 ) + n(u, L 2 , L )) = 



and that r(L , L\, L 2 ) = ch(V ) + da(0). This proves Proposition EO. □ 
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4 Computation of t(Lq, Li, L2) 

Let Lq,L\,L 2 C V be pairwise transverse Lagrangian subspaces. Then V — L\ © L 2 and 
we can write Xq = X\ + Xi G Li, i — 0,1, 2. We define a hermitean quadratic form Q 
on L by 

Q(x ) := (Ixi,x 2 ) , 

where (/,.,) is the symplectic form of V associated to I and the Hilbert space structure 
of V. It is easy to see that Q is nondegenerate. Thus we can split Lq = Lq © Lq into 
the positive and negative eigenspace of Q. Returning now to the family case we obtain a 
decomposition L = Lq © Lq of the bundle of Lagrangian subspaces Lq C B x V which 
is induced by the two other subbundles L\, L 2 . 

Proposition 4.1 We have 

t(L , Li, L 2 ) = ch(L+) - ch(L ) e H*(B, Z) . 

Proof. The proof of the proposition consists of two steps. 

1. Using the i^-theoretic relative index theorem we reduce to an index problem for 
a family of Dirac operators on the disc. The parameter dependence of this family 
is again built in through the boundary conditions. 

2. We then consider the "universal" family of such operators which is parametrized by 
a space which is homotopy equivalent to the space of all triples of pairwise transverse 
Lagrangian subspaces of V. It suffices to verify the assertion of the proposition in 
this special case. 

First we want to compactify M by cutting off the cylindrical ends and gluing in half discs. 
The resulting manifold M is then topologically a disc. Let /9 + be the corresponding Dirac 
operator. We want to find a family of boundary conditions parametrized by B such that 
ch (index (/9 + )) = ch(index(/9 + )). 
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Let Y C R 2 denote the subset 

Y := {{s, i) G R 2 | s > 0, i G [-1/2, 1/2] or s < 0, t 2 + s 2 < 1/4} . 

Then F is a Riemannian surface with (^-boundary and one cylindrical end. Let Sy be 
the spinor bundle of Y. Let E Y := Sy ® (W © W op ) and /9 y be the Dirac operator on 
E Y . We trivialize Sy and £y using the flat Levi Civita connection and denote the typical 
fibre of E Y by E. Then 

The space V := -E + is a symplectic vector space with symplectic structure induced by 

i = °:°t- 

Let now Lq, Li be transversal Lagrangian subspaces of V. We want to construct a 
family of Lagrangian subspaces L(s,t) = L(s, t)(Lo, L\) which is parametrized by (s,t) G 
dY, and which depends smoothly on Lq, Li, such that L(s, t) = L for s>0, t — 1/2 and 
L(s,t) — Li for s > 1, t — —1/2. If B 3 b — > (L (6), Li(6)) is a smooth family of pairs 
of transverse Lagrangian subspaces, then we require that the index of the Dirac operator 
/) Y subject to the family of boundary conditions L{., .)(L (b), Li(b)) is trivial. 

We first set 

[ L (s, t)edY,t>0 

L(s,t)(L ) := J IL (s,t) G dY,s > 0,t = -1/2 , 

[ <T~n(s, t)Lo (s, t) G dY, s < 0, t < 

where n(s,t) := 2(s<r+ + tcr t + ) is the Clifford multiplication by the normal vector. It is 
easy to see that L(s,t) is C 1 with respect to (s,t). If B 3 b — > L (6) is a smooth family 
of Lagrangian subspaces, then we consider the family {jdy(b)} b€B given by /) Y subject 
to the boundary conditions given by L{., .)(L (6)). 

Lemma 4.2 In K°(B) we have 2 index(/9y) = 0. 

Proof. We claim that /9y is equivalent with its adjoint (/d Y )*. Thus 2 index( /9y) = 
index(/9y) - index(^y)* = 0. 
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We now show the claim. First we describe the adjoint (f) )*. Note that E~ is a 
hermitean symplectic vector space with symplectic structure induced by cx+<7 t _ . Then the 
adjoint of 0y * s the operator /) Y subject to the boundary conditions given by the family 
of Lagrangian subspaces of E~ 

B3b^ {(s,t) £ dY h- r(s,t)L(s,t)(L (b))} , 

where t(s, t) is the Clifford multiplication by the tangent vector at (s, t) £ dY. If ip + (s, t) 
is a section of Ey, then we set (U + ip + )(s, t) := cr^-?/> + (,s, — i). Then f/ + is unitary, and 
U + ip + is a section of E Y ■ It is easy to check that the equality of differential operators 

is compatible with the boundary conditions. This shows the claim. □ 



Let Q(x,y) = (Ix,y) be the (hermitean) symplectic form on V. Let A denote the 
manifold of all Lagrangian subspaces of V. For L £ A let Cl denote the subset of all 
Lagrangian subspaces V £ A which are transverse to L. The following discussion is 
parallel to that in p. 117/118. Let Pjj denote the projection from V to L' with kernel 
L. It is easy to check that Q(Pi'X,y) + Q(x,Pi>y) = Q(x,y). We define the hermitean 
quadratic form 

Qu{x,y) := n{P L ,x,y) - ^{x,y) . (10) 

Indeed 

Ql> (x, y) = Q(P L >x, y) - ^0(x, y) 
= -n(x,P L ,y) + ^Q(x,y) 

= tt(P L ,y,x) - -£l(y,x) 
= Ql'(v,x) ■ 

We have 

QL'{x,y) = --tt{x,y), VxeL,yeV. (11) 

Any hermitean quadratic form Q satisfying (|TTD determines a Lagrangian subspace V 
such that Q = Ql>- In fact let P' be determined by Q and flT0|), then V is just the 



4 COMPUTATION OF r(L , L u L 2 ) 



16 



1-eigenspace of P' . Thus we can identify Cl with the space of hermitean quadratic forms 
satisfying ([□]). In particular, Cl is an affine space where the affine structure only depends 
on L. 

We now can construct the desired family L(s,t)(L , Li). Note that IL ,Li G C Lo , 
and there is a natural affine path L(r) = L(t)(Lq, Li) with L(0) = ILq, L(l) = L\. We 
choose a smooth cut-off function \ £ C°°([0, 1]) with x(t) G [0, 1], x(X) = near i = 
and x(^) = 1 near t — 1. We set L(s,t) = L(s,t) for all (s, t) G <9F except for t = —1/2, 
s G [0,1], where we set L(s,t) = L(x(s))(L , L\). Then L(s,t) is C 1 with respect to (s, t) 
and depends smoothly on L ,Li. Let {^y(&)}6eB denote the family of Dirac operators 
given by /)y subject to the boundary conditions defined by {L(., .)(Lo(b), Lx(b))}. Then 
jdy an d Py are homotopic families and thus 2 index( /9y) = in K°(B). The upshot of 
the construction above is that we associated to a pair L , L\ of transversal Lagrangian 
subspaces a canonical path j(L ,Li) from L to L\ which is parametrized by dY . The 
path 7(L , Li) depends smoothly on the pair (L , L\) and has (in a certain sense that will 
become clear below) the minimal winding number. 

Now we can cut-off the six cylindrical ends of M and glue in the pieces Yi = {(s, t) G 
Y \ s > 1}, i — 0, . . . ,5. The resulting manifold M is topologically a two disc. 

To be more precise let Zi = [0, oo) x [—1/2, 1/2], i — 0, ... ,5, denote the cylindrical 
ends of M. Then we cut at {1} x [-1/2, 1/2]. We identify (s,t) G Z t with (2 - s,t) G Y { . 
Moreover, we use a s : E\Qz t — > Ey^dYi in order to glue the bundles. Then /9 + glues 
with f)y. Assume that on the component [0, oo) x { — 1/2} of dZi we have the boundary 
condition given by Li (resp. -^1-3) and on [0, 00) x {1/2} we have the one given by 
(resp. Lj_2), where L 3 = L . Then on the boundary part of M which comes from Y^ 
we choose the path a s Tj(Li, L i+ i) (resp. cr s T7(Lj_ 3 , Lj_ 2 )), where r again denotes the 
Clifford multiplication with the unit vector tangent to the boundary. This path indeed 
connects Lj with Thus we have constructed a closed path j(Lq, Li, L 2 ) of Lagrangian 
subspaces of V which is parametrized by dM, and which depends smoothly on the triple 
{Lq, Li, L 2 ). 
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We use this path in order to define the boundary condition for the W © M^ op -twisted 
Dirac operator /9 + on M. Recall that we identify V with the fibres of the bundle E^ 
using the parallel transport along dM. Using the i^-theoretic relative index theorem |3j 
it is easy to see that index(/9 + ) = index(/9 + ) G K°(B)[l/2}. Indeed, the relative index 
theorem states that 

5 ~ + 5 

index ( jd + ) + ^ index (/9^) = index (p ) + ^ index (j8%) , 

i=0 i=0 

where Zj = [—1/2, 1/2] x R and jd\. is the W © iy op -twisted Dirac operator subject to 
the boundary conditions given by Lj at { — 1/2} x R, Lj + i at { — 1/2} x R (resp. Lj_3 
at {-1/2} x R, Li_ 2 at {-1/2} x R). But index(^) = in K°(B)[l/2] for symmetry 
reasons. 

Deforming the metric of M to the standard metric of the two disc we do not change the 
index. Below we will assume that M is isometric to the two disc. The parallel transport 
in E + along dM with respect to the globally flat metric gives an identification of V with 
the fibres of E + which is topologically different from the one used above. This fact has 
to be taken into account below. We have now finished the first part of the proof of the 
proposition. 

We start with the second part. Let A 3 be the space of triples (L , L±, L 2 ) of pairwise 
transverse Lagrangian subspaces of V. Let Sp(V) denote the group of symplectic auto- 
morphisms of V. Note that ifl is a non-degenerate hermitean form of signature (1,1), 
where I = dim c (V)/2. Thus Sp(V) = U(l,l). The group Sp(V) acts on A 3 . We claim 
that A 3 is the disjoint union of orbits of Sp(V). 

First it is easy to see that Sp(V) acts transitively on the space A. Let Lq G A. Then 
any L\ G £l can be written as {Bx + x \ x G IL } for some B G End(IL , L ). The 
condition that L\ is Lagrangian translates to Q(Bx, y) + Q(x, By) = for all x, y G IL . 
This is equivalent to (BI)* = BI, where * is defined with respect to the hermitean metric 
of V. Thus we can parametrize Cl by the symmetric endomorphisms of Lq. Writing 
V — L © ILq it is easy to check that 
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ALq = Lq and AILq = L\. Thus Sp(V) acts transitively on the set A 2 of pairs (Lq,L\) 
of transverse Lagrangian subspaces. 



Let G denote the stabilizer of the pair (Lq,ILq). Let j : GI(Lq) — > GI(ILq) denote 
the unique isomorphism such that 

GI(Io)9A- f ^ ° (12) 

Then j(A) = — /(A -1 )*/. If L 2 G A is transverse to L and JL , then we write 

1 B 




for some invertible B as above. If g G G is represented by A G Gl(L ) according to (|T^), 
then 

/ 1 -ABIA*I \ 

9i2= (o i )' L °- 

The action of G on £i is hence given by action of Gl(L ) on the symmetric endomor- 
phisms of Lq by conjugation. Thus the signature of the symmetric BI is the only invariant 
of the orbit of G generated by L 2 inside the space of Lagrangian subspaces which are trans- 
verse to Lq and IL . We conclude that A 3 is the disjoint union of orbits of Sp(V) of points 
(Lq, ILq, L 2 ), which are distinguished by the signature of a matrix BI defined by L 2 . 



We now consider the orbit generated by a triple (L , IL , L 2 ) G A 3 . The stabilizer U 
of (Lq, ILq, L 2 ) can be identified with the subgroup of GI(Lq) fixing the hermitean form 
on Lq defined by BI. Let K C U denote a maximal compact subgroup. We can choose 
K such that it fixes the metric (.,.), hence K is a subgroup of the unitary group of V. 
But then it fixes /, too. 



Using the explicit formulas given above one can check that the definition of the closed 
path j(Lq, L\,L%) only depends on I (and not on a s , a t or on the choice of coordinates). It 
follows that 7(Lo, ILq, L 2 ) = ^(Lq, ILq, L 2 ) for all k G K. We now globally trivialize S, E 
using the parallel transport given by the globally flat metric of M. Along the boundary 
dM the old and the new trivialization of S are related by a twist of — 2tt in the structure 
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group of S. Note that are the ±i eigenspaces of the Clifford multiplication by the 
volume form of M. The image of the path j(Lo, L±, L 2 ) in the new trivialization can be 
obtained (up to homotopy) by j(L , L ± , L 2 )(z) := z~ llA f(L , L ± , L 2 )(z), z E S 1 = dM. We 
see that ^y(L , L l7 L 2 ) is ^-invariant, too. 

Let (x, y) be oriented, flat orthonormal coordinates on M and write /) = o x d x + o y d y . 
If we let K act on E" by, say, K 3 k 1— > —o+ko~ G End(E~), then f) + is i^-equivariant. 
We now consider the family of Dirac operators parametrized by Sp(V), given by f) + 
subject to the boundary conditions Sp(V) 3 g 1— > ^y(gL , gIL , gL 2 ). This family is Zf- 
equivariant and we go over to the quotient family parametrized by Sp(V)/K which we 
denote by f) + . 

Let X := index(/9 + ) G R(K) be the K-equivariant index of /) + subject to the bound- 
ary conditions given by j(Lo, IL , L 2 ), where R(K) denotes the representation ring of K. 
Then index(^ + ) = [Sp(V) x K X] G K°(Sp(V)/K). The following Lemma implies the 
proposition for the family ~jd . 

Lemma 4.3 Let (n,m) be the signature of the quadratic form defined by BI on L . Then 
X = C n — C m , where C™, C m are the m- and n- dimensional standard representations of 
the corresponding factors of K = U{n) x U (m) . 

Proof. Let T C K be a maximal torus. If Y G R(K), then Y T denotes the restriction to 
T. It is sufficient to show that X T = C£ - CJp. 

We first consider the case that W = C. Then f) + can be expressed in terms of complex 
geometry. Indeed we have 

HID- 

Writing d — d x + id y , d = d x — id y we obtain 
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and hence 




A one-dimensional subspace C(a,b) G V, a,b E C, is Lagrangian iff |o| = |6|. We 
parametrize the Lagrangian subspaces of V by S* 1 associating to <f> G S 1 the space C(0, 1). 

The space of pairwise transverse triples A 3 consists of two components which are 
distinguished by the cyclic order of the parameters 0; G S 1 of Lj. Let A^ be the component 
with order O < <pi < <p 2 and A 3 1 be the component with order O < <p 2 < 4>\. The T- 
equivariant index of /) + only depends on the homotopy class of the path 7(L , L ± , L 2 ). 

We fix an identification ^(S 1 ) — Z, 7 1— > [7], such that the path mapped to 1 
has positive orientation. We leave to the reader to compute [y(L , Li, L 2 )] G Z for 
(L ,L U L 2 ) G A^. The result is [-f(L , L 1 , L 2 )} = on A 3 and [^(L , L 1 , L 2 )} = 2 on 



Lemma 4.4 Let = C ; ano? /et t/ie boundary condition of /9 + 6e given by a closed path 
7 of Lagrangian subspaces. Then index(/9 + ) = — [7] + 1. 



Proof. Let n G Z be represented by the path 7 n (</>) = C(0™, 1), G 5 1 . The kernel of /9 + 
with boundary condition given by 7„ can be identified with the space of pairs (/, g) of 
functions on M, where Bg — 0, df — and z n g(z) = f(z) at S* 1 . This space is non-trivial 
for n < 0, and it is spanned by (z~ n , 1), (z _ri_1 , z), . . . , (1, 2 _ri ). One can check that (^ + )* 
is given by 

' 8 
-d 



and that the boundary condition is given by the path 7„+2- The kernel of (/9 )* can 
be identified with the space of pairs (/, g) of functions on M with df — 0, dg — 0, and 
z n ~ 2 g(z) = f{z). The kernel of (/9 + )* is non-trivial for n > 2, and it is spanned by by 
(^ n - 2 , 1), (z n ~ 3 , z),..., (1, 2™- 2 ). It follows that index(/9 + ) = -n + 1. □ 
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We now finish the proof of Lemma in the case W = C. We must show that 
the signature of the quadratic form given by BI is (1,0) on Af and (0, 1) on A 3 X . Let 
Iq = (1, 1), li = (—1, 1), and li = (—i, 1) generate the Lagrangian subspaces L , IL , L 2 . 
Then (L , IL , L 2 ) G Af . We have l 2 ~ l + j^Ji and Il = -il x . It follows that BI = 1. 
The other case is similar. 



In order to complete the proof of Lemma 4.3 in the general case one reduces to the 



special case W = C by considering the direct sums. □ 



We now finish the proof of the proposition. Let {A?} denote the set of components 
of A 3 and choose Xi G A 3 for all i. Let Ui be the stabilizer of Xj in Sp(V). Then 
U, Sp(V)/Ui = A 3 parametrizes the universal family of boundary conditions for /) + given 
by a family of path' B 3 b i— > j(L (b), Li(b), L 2 (b)). Indeed, any such family can be 
pulled back from the universal one using the canonical map B — > U 4 Sp{V)/Ui. Since 
the fibres of 7Tj : Sp(V)/K — ► Sp(V)/Ui are symmetric spaces of non-compact type, 7r^ 
is a homotopy equivalence. Since the proposition is proved for /9 + (for each component 
separately) it is also true for the universal family, and hence in general. □ 



Remark : We sketch another proof of Proposition |4.1| which avoids the use of the 
universal family and the equivariant index. 

We first consider a model case where V mo d e i '■= C 2 and I := diag(z, —i). Let k, i = 
0, 1,2, be the Lagrangian subspaces of V mo d e i parametrized by 0o : = 0, := ±arg(^|), 
02 := i-e., h = {(e l ^x,x) G C 2 | x G C}. Let fl± be the Dirac operator on M with 
boundary conditions given by the triple lo,h,l 2 - We have index (^) = ±1. This can be 



proved in the same way as Proposition |4.1| , but the proof simplifies due to the facts that 
dim(V mo dei) = 2, and that B is a point. 
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We now turn to the general case. Let V be any finite dimensional Hilbert space with 
hermitean symplectic structure, and let {Lq, L\, L 2 }b£B be a family of pairwise transverse 
Lagrangian subspaces of V. Then we can write Lj = {x + AJ.x \ x G IL }, i = 1,2, where 
Ai are smooth symmetric bundle endomorphisms of the subbundle Lq C B x V such that 
Ai — A2 is invertible. 

We show that this family of triples is homotopic to a family in some standard form. 
Consider the family A(t)i := \((l-t){Ai- A^+tAi), t G [0,1]. Then A(t)i- A(t) 2 = 
Ai - A 2 is invertible for all t. Moreover, A(l), t = A4 and A(0) 1 = A 1 - A 2 = -A(0) 2 . 
Thus up to homotopy we can assume that A\ = —A 2 = A, where A is invertible. There 
is a further index bundle preserving homotopy of A to A/|A|. Thus we can assume that 
A 2 = 1. 

Let /9 + be the family of operators on M defined by the family {Lq, Li, L 2 }beB as- 
sociated with A. Let Lq be the ±l-eigenspaces of A. We will define isomorphisms 
$ : ker( / 9+) <g> L% © ker( / 9+) ® L = kex(j9 + ), * : coker( / 9+) ® © coker(/9l) <g> L = 
coker(/9 + ). 

First we fix a basis vector t> m0( fc« € /o- Then any v G Lq defines an unique symplectic 
embedding v* : V mo dei c— > V such that v*(v moc iei) = v. If v , w G and /i G C, then we 
have (/it> + w)* = One can check that t>*(ker(/9±)) C ker(/9 + ), t>*(coker(/9^)) C 

coker(/9 + ). We define ©/W) := v*(f)+vi(f), ^(g<g>w®g'®w') := w*(g)+w'*(g'). 

In follows that 

index( / 9 + ) = index( / 9+)[L+] + index( / 9+)[L ] = - [L ] G . 
This finishes our sketch of an alternative proof of Proposition |4.1| . 

Example : For the purpose of illustration let us consider an example. Let V := C 4 
equipped with some complex structure I such that L = C 2 C C 4 is Lagrangian. Let 
B := P 2 C If T — > B denotes the tautological bundle of B, then we have an orthogonal 
splitting of the trivial bundle B x Lq as T © T -1 . For b G B let be the quadratic form 
on Lq given by the matrix diag(l, —1) with respect to the splitting Lq = Tb © T b x . The 
family of quadratic forms {Qb}beB induces a family of Lagrangian subspaces {L 2 {b)}b^B 
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such that L 2 (6) is transverse to L Q , IL for all b G B. Thus r(L , iX , -^2) is defined, and 
we have 

t{L , IL , L 2 ) = ch(T) - ch(T*) = 2 Cl (T) . 
This class is non-trivial. 

Remark : It would be desirable to have an explicit formula for the 77-form generalizing 
the result of 0. 
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